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Implementation of TCP Westwood ABSE on FreeBSD 

• * 

UCLA Computer Science Department Network Research Lab . 
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1 . Installation 

We have a kernel source of TCP Westwood ABSE for FreeBSi). Release 4.4. 

« * 

m • 

1.1. Install FreeBSD 4.4 

» 

Don't forget to install the kernel source. 

Note: If tiiere is not a /usr/src/sys directory on your system, then the kernel 
source has not been installed. The easiest way to do this is by running 
/stand/sysinstall as root, choosing Configure, then Distributions, 
then src, then sys. If you have an aversion to sysinstall and you have access 
to an "'official*' FreeBSD CDROM, then you can also install the source from 
the command line: 

% mount /cdrom 
• % mkdir -p /usr/src/sys. - 
% In *s Aisx/src/sys Isys 

%cat /cdrom/sys/ssys. [a-d]* | tar -xzvf- 

1 .2. Get and extract the Westwood ABSE archive 

Gret the eurchive of TCP Westwood ABSE kernel soiuice. 

m 

Then; extract it. 
%cd/usr/src 
' %tar zxvf westwood^ABS£*R45-I2I402.tgz 

1.3. Compile and install Westwood kernel 

% cd /usr/src/sys/i386/conf 

% Aisr/sbin/obnfig WESTWOOD.ABSE 

% cd ..A7compile/WESTWOOD .^SE 

% make depend 

% make 

% make install 

%iehoot 

* 

1.4 If you are provided with TCPW Binary . 

If you are provided with the TCP W binaries the easiest way to install TCPW is to 
first 9^ve it on the hard drive. Then reboot FreeBSD and when it first begins to reboot 
press the ESC key and type the entire path to the kernel binary. 



2. Configuration of Westwood Kernel 

ABSE/BE kernel can be configured by running '^sctl'. 

2.1. TCP version 

' We can select a TCP version among Westwood ABSE, Westwood BE and NewReno, 
and change it anytime, TCP version of each connection is determined at a 
connection's startup time. 

(1) TCP ABSE 

% sysctl net.inet.tcp-tcp_westwood=l 

% sysctl net.inet.tcp-tcp_westwood_abse=l 

(2) TCPBE 

% sysctl net.inet.tcp.tcp^westwood=l 

% sysctl net.inet.tcp-tcp_westwood_abse=0 

(3) TCP NewReno 

% sysctl net.inet.tcp.tcpjwestwood=0 

We can also enable TCP Astart or AgUe Probing function in ABSE 
% sysctl net.i|iet.tcp.tcp_westwood=l 
% sysctl net.inet.tcp.tcpjvestwood_abse=l 
% sysctl net.inet.tcp-tcp_westwood_astart=l 

Persistent Non-Congestion Detection (PNCD) is enabled by 
% sysctl net.inet.tcp.tcp_we8twood=l 
% sysctl net.inet.tcp.tcp^westwood_abse=l 
% sysctl net.inet.tcp.tcp_westwood_astart=l 
% sysctl net.inet.tcp.tcpjwestwoodjicd=l 




3. Details of Implementation of TCPW ABSE Protocol 



We have implemented TCPW ABSE protocol on Free BSD 4.4. In this section, we will 
present details of the implementation. - • 

• ■ 

* 

3.1. Issues 

We have three main issues to consider in implementation of TCPW ABSE protocol. 
We will discuss the issues and our solutions here. 
3.1. 1, Cumulative ACK handling 

TCPW ABSE Protocol estimated the bandwidth by a difference of ACK sequence 
number between two packets. We need to care the special situation lilce reordering 
and duplicate ACKs. Normally, we can not get the accurate information in such a 
situation. 

■ • 

3. 1 . 1 . 1 . Handling reordering packets 

When a source node received a reordered packet which has smaller ACK sequence 
number than the previous packet, the sender can ndt predict how many bytes the 
destination node received in the corresponding time period. Thus, we neglect the 
reordered packets. The source maintains the maximum sequence number of ACK 
packets, and if the ACK sequence number of the received packet is less than the 
maximum one, it assumes that it is a reordering packet and just neglects it. If the 
maximum sequence number becomes too large due to some error, all packets are 
treated as reordering packets. To avoid this iniproper situation, the source node 
enforces that the maximum sequence number never exceeds th^ maximum sequence 
number of packets that have ever been sent. An example of Reordering is shown in 

• Figure 1. Packets with ACK sequence number 600, 1100 and 2100 are neglected 
because their sequence numbers are. smaller than the maximum sequence number. 




Desthatbn 
sendhgACK pkt 



Souxce 
zecevhg ACK pkt 

M ax seq U 




100 



neglsct 



1600 



1000 Bytes 
tecei/ed 



1500 Bytes leceved 

Figure 1 ACK packet Reordering 
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3.1.1.2. Expected ACK sequence number 

TCPW ABSB Protocol estimates the bandwidth as a difference of ACK sequence 
number divided by a difference of receiving time between two packets. If the source 
receives a Duplicate ACK, we can not calculate the amount of bytes received. To 
solve this problem, we introduce the expected ACK sequence number instead of the 
real ACK sequence number. The source assumes that a duplicate ACK packet 
corresponds to an average TCP segment si?e. The expected sequence number is 
increased by the average TCP segment size. The average size is calculated as 
exponential averaging of sending packets. Like calculation of the maximum ACK 
sequence number, it enforces that the expecting sequence number never exceeds the 
maximum sequence number of the packet that have ever been sent. Examples of the 
expected sequence number calculation are shown in Figure 2 and Figure 3, 
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Figure 2 Example of the expected ACK seq % calculation in duplicate ACKs. 
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Figure 3 Example of the expected ACK seq % calculation in partial ACKs 



3.1.2. CPU clock granularity problem 

The CPU clock in FreeBSD is called ticks. The default unit of ticks is 10msec. This 
low granularity causes two major problems. 

m 

3.1.2.1. Several packets can be received at the same time unit. 

When several packets are received at the same unit, we can not estimate the 
bandwidth between these packets because the time interval is Osec. We only use the 
first received packet in each ticks to calculate bandwidth. Figure 4 shows an 
example of receiving several packets in one ticks. 
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Figure 4 Receiving several paclcets in one ticks. 

We have two benefits by using one packet for each 10msec. At first, we only need 
bandwidth calculation once per 10msec. It reduces the CPU load in high speed 
connections. The other is that we only need to accommodate one ACK packet 
information per IQmsec. It reduces an amount of the buffer for storing ACK packet- 
information. However, we must care effects of neglecting the packets in the same 
tick. We will evaluate difference of simulation and this implement in the experiment 
section. 



3.1.3. ACK History Management 

TCPW ABSE Protocol needs to keep a number of ACK infonnation, sequence 
number and receiving time, to calculate the Bandwidth sampling. The maximum 
time interval for storing ACK information is determined by the sampling interval T. 
The maximum value of T is one RTT- Thus, the number of packets needs to be 
stored: N is calculated as 

_ MaximumWindowSize 
PacketSize 

If we a&sume that the Maximum Windows Size is 64kbytes and the packet size is 
512 bytes, we need 128 packets. However, if we want to achieve the high 
throughput in a large RTT hke 45Mbps in RTT=70nis. the windows size should be 
more than 3Mbytes, and N should .be more than 6kbytes. 

Fortunately, due to 10ms ticks restriction, we only dcconrunodate one packet for 
each ticks unit. Thus, we can calculate N as 



ticks _ time _ unit (default „ lOw sec) 
Now, we can detennine N indifferent to throughput. If we set N=256, we can 
support TCP connections with less than 2.5sec RTT. Though 2.5sec RTT is enough 
large in the current Internet, we also need to handle a connection with more than 

■ 

3sec RTT. To support a very long RTT, we have thought upon the three ideas. 

(1) Assign N as a kernel parameter. An administrator can change N by 

^sysctl* if he needs. 

<2) Increase/decrease N in accordance with the RTT value dynamically. It 
must make the code complex. 

(3) Introduce a new parameter, the minimum time interval for storing the 
ACK information, and change it adaptively based on RTT so that we can 
acconunodate all packets within T without changing N. 

We select (3) in the current implementation because we can detemilne N indifferent 
to RTT value. 



4. The code Overview 



Bandwidth Estimation Function is called 
whenever an ACK packet is received. The flow 
chart of Bandwidth Estimation function is shown 
in Figure 5. 

(1) Reordering 

If the packet is reordered, the calculation is 
cancelled. 

(2) Updating Expected sequence number 

(3) Check receiving time 

So, if the packet is received at the same tick as the 
previous stored packet, the calculation is 
cancelled. 

(4) Stored to the ACK information Array 

The expected sequence number and receiving 
time is stored in the ACK information ^ay, 

(5) Calculate Filter Gain Adaptation. 
Instability Uk and ABSE filter parameter Xk is 

calculated ^ 
I/, = iS • £/»_, + (1 ^ fi> I - I 
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FiguK . 5 Flow chart of 
Bandwidth Estimation functions 



Umax is calculated as the maximum instability in 
the ten most recent observations. Umax is possibly 
becomes 0, and it causes 0 division error. We 
define Tk=RTt if Uinax=0. 
(6) Calculate ABSE adaptive sampling inteirval 

When a sender received a packet, the bandwidth sampling is computed based on the 
amount of data acknowledged during the interval T. T is calculated as 



Tu = RTT 



cwin - C • RTT^ 



• « 



cwm 

(7) Update Bandwidth Estimation 

I*rom the ACK information array, get the oldest and newest ACK during the interval T. 
and calculate the sample bandwidth 5^ and the estimated bandwidth 5^ . If T is less 
than or equal to 0 or there are only one ACK during the time interval T, it uses the two 
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